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Abstract 


random  process  that  is  second  order  stationary. 


This  paper  surveys  some  recent  results  concer¬ 
ning  the  effects  of  a  zero  memory  nonlinearity  on 
stationary  random  processes.  Emphasis  is  placed 
upon  the  mean  square  continuity  of  the  output,  the 
autocorrelation  function  of  the  output,  equivalence 
classes  of  zero  memory  nonlinearities,  and  bandwidth 
properties  of  the  output.  A  new  result  concerning 
the  effect  of  a  zero  memory  nonlinearity  on  the 
spectrum  of  randomly  modulated  Gaussian  noise  is 
presented . 


Mean  Square  Continuity 

In  the  analysis  of  second  order  random  pro¬ 
cesses,  the  property  of  mean  square  continuity  is 
frequently  assumed.  We  recall  that  the  mean  square 
continuity  of  Y(t)  is  given  by  the  condition  that 

lira  E  |[Y(s)  -  Y(t)]2l  =  0 

S^t  "  ' 


Introduction 

From  the  viewpoint  of  second  moment  theory, 
the  study  of  linear  systems  with  random  inputs  has 
been  fairly  well  developed.  However,  such  is  not 
the  case  for  nonlinear  systems.  The  difficulties 
that  arise  in  problems  associated  with  nonlinear 
systems  with  random  inputs  are  frequently  insurmoun¬ 
table,  and  a  completely  general  approach  to  nonlin¬ 
ear  transformations  upon  random  processes  does  not 
appear  possible.  Much  of  the  success  in  this  area 
has  been  achieved  by  restricting  attention  to  cer¬ 
tain  situations  involving  particular  classes  of  ran¬ 
dom  inputs  and  particular  forms  of  nonlinear  sys¬ 
tems  . 

One  form  of  nonlinear  system  that  has  been 
successfully  analyzed  to  a  good  degree  is  the  zero 
memory  nonlinearity  (ZNL) .  In  statistical  communi¬ 
cation  theory,  as  well  as  other  areas  of  engineer¬ 
ing,  we  are  frequently  interested  in  ZNL's  with 
random  inputs.  For  example,  limiters,  rectifiers, 
power  Law  devices,  and  other  ZNL's  are  an  integral 
part  of  many  systems. 

In  this  paper  we  will  be  concerned  with  time 
invariant  ZNL's.  A  ZNL  will  denote  a  transforma¬ 
tion  such  that  the  output  at  time  t  depends  only  on 
the  input  at  time  t.  The  input  will  be  denoted  by 
X(t).  In  the  sequel  we  will  assume  that  X(t)  Is  a 
zero  mean,  second  order  random  process  that  is 
second  order  stationary  and  mean  square  continuous. 
The  parameter  set,  denoting  the  time  index,  will  be 
the  real  line.  The  general  class  of  ZNL's  #  will 
be  taken  as  the  class  of  all  Borel  measurable  func¬ 
tions  g(-)  such  that  g [ X ( t ) ]  is  a  second  order  ran¬ 
dom  process.  We  will  identify  any  two  ZNL's  g^(*) 

and  g2(*)  such  that  g^XCt)]  and  g2[X(t)]  are  equi¬ 
valent  random  processes.  The  output  of  the  ZNL  will 
be  denoted  by  Y(t).  Thus  Y(t)  is  a  second  order 


for  all  t.  For  Y(t),  mean  square  continuity  is  a 
necessary  and  sufficient  condition  for  the  exis¬ 
tence  of  a  measurable  standard  modification  of  the 
1-3 

random  process  .  Measurability  of  a  random  pro¬ 
cess  is  necessary  to  take  full  advantage  of  the 
apparatus  of  measure  theory.  For  example,  measu¬ 
rability  is  used  to  justify  exchanging  the  order  of 
the  expectation  operator  and  the  integral  of  a  ran- 
4 

dom  process  .  In  applications,  this  is  pertinent 
to  the  linear  filtering  of  Y(t).  Also,  mean  square 

continuity  is  a  necessary  and  sufficient  condition** 
for  the  popular  spectral  representation  of  Y(t). 

2  6  7 

In  some  general  treatments  *  *  of  wide  sense  sta¬ 
tionary  random  processes,  mean  square  continuity  is 
taken  as  a  standing  assumption. 

g 

The  following  result  Is  due  to  Wise  and  Thomas. 

Theorem  1 :  If  g  f  then  Y(t)=gfX(t)]  is  mean 
square  continuous. 

On  the  basis  of  this  result,  we  see  that  the 
output  of  the  ZNL  is  mean  square  continuous,  even 
though  the  ZNL  g(*)  might  not  be  continuous.  Thus, 
from  the  preceding  comments,  we  see  that  Y(t)  pos¬ 
sesses  a  spectral  representation.  It  is  the  spec¬ 
tral  representation  which  affords  us  the  interpre¬ 
tation  of  the  bandwidth  properties  of  Y(t),  which 
will  be  considered  later  in  the  paper.  In  summary 
then,  we  ",ee  that  the  output  Y(t)  is  a  second  order 
random  process  that  Is  second  order  stationary, 
that  is  mean  square  continuous,  that  possesses  a 
spectral  representation,  and  that  is  equivalent  to 
a  measurable  random  process. 
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The  Autocorrelation  Function  of  the  Output 

In  this  section  we  will  assume  that  X(t)  is  a 

2 

Gaussian  process  with  a  positive  variance  o  and  a 
normalized  autocorrelation  function  p(x).  Let 
R^Ct)  denote  the  autocorrelation  function  of  the 

output 


2 

lation  function  o  p(t).  Although  it  may  not  be 
clear  from  (1),  it  can  be  seen  from  (4)  that  this 
is,  in  general,  not  possible.  That  is,  we  see  from 
(3)  that 


g(*)  =  £  bnen(x) 

n“0 


(5) 


^(t)  «  E  |  Y (t)  Y (t+T )  | 

=  E  {  g[X(t)]  g[X(t+T)]  (  .  (1) 


A  direct  approach  to  evaluate  R^Cx)  is  often  diffi¬ 
cult.  Instead,  several  indirect  approaches  have 
been  introduced  which  frequently  simplify  the  eval- 

9-13 

uation  of  R^Cr),  These  include  Price's  Theorem  , 

transform  methods,  and  series  expansions.  A  col¬ 
lection  of  useful  techniques  for  studying  the  out¬ 
put  autocorrelation  function  of  a  ZNL  with  a  Gaus- 

14 

sian  input  is  presented  by  Thomas  .  In  particular, 
limiters  and  power  law  devices  are  treated,  and 
many  useful  references  are  given. 

We  will  outline  a  general  method  for  analyzing 
Ry(x)  which  is  based  upon  a  method  introduced  by 

*  15 

Barrett  and  Lampard  .  Let 


en(x) 


(2) 


where  H^(x)  is  the  n-th  Hermite  polynomial  defined 
by 

Hn(x)  =  (-1)°  exp(f-)  ~exp(-  |~)  . 

dx 

and  let 

b-=  it: 


where  the  series  is  mean  square  convergent.  Thus 
we  see  that  the  ZNL  g(-)  is  determined  by  the  se¬ 
quence  jb^J-  »  while  from  (4)  we  see  that  the  output 

autocorrelation  function  is  determined  by  the  se¬ 
quence  \(b  )  >  .  This  motivates  the  concept  of 
l  ^  /  1617 

equivalence  classes  *  of  ZNL's.  That  is,  the 
equivalence  class  of  a  ZNL  is  the  set  of  all  ZNL's 
which  produce  exactly  the  same  transformation  upon 
the  autocorrelation  function  of  the  input.  The 
equivalence  class  of  a  ZNL  is  therefore  the  set  of 
all  ZNL's  that  can  be  obtained  by  changing  the 
signs  of  the  coefficients  in  (5).  It  is  straight¬ 
forward  to  see  that  this  does  result  in  an  equiva¬ 
lence  relation;  that  is,  it  is  reflexive,  symmetric, 
and  transitive.  We  note  that  the  sum  in  (5)  trun¬ 
cates  if  and  only  if  g(«)  is  a  polynomial.  Thus, 
the  equivalence  class  of  a  ZNL  is  a  finite  set  if 
and  only  if  the  ZNL  is  a  polynomial. 

Utilizing  the  equivalence  class,  we  can  give 
examples  of  ZNL's  having  greatly  different  struc¬ 
tural  properties  which  produce  exactly  the  same 
output  autocorrelation  function  when  the  input  is 
given  by  X(t).  For  example,  the  following  three 

ZNL's  belong  to  the  same  equivalence  class^: 


(3) 

=  E  |on(X(t)]  g[X(t))l  . 

Then  the  output  autocorrelation  function  is  given 
by 


By  utilizing  the  equivalence  class,  one  can  pre¬ 
serve  the  second  moment  properties  associated  with 
a  given  ZNL  but  perhaps  choose  a  ZNL  having  more 
acceptable  functional  properties,  e.g.  dynamic 
range,  ease  of  implementation,  etc. 


VT>  -  (bn)2  IpCt)]"  .  (4) 

n»0 

This  series  is  absolutely  and  uniformly  convergent. 
If  the  sum  is  truncated,  the  result  is  still  a 
valid  autocorrelation  function;  that  is,  it  is  non¬ 
negative  definite.  Also,  the  truncation  error  can 
be  uniformly  bounded  in  a  straightforward  manner, 
since  |p(x)|  <_  1,  If  the  ZNL  g ( • )  is  a  polynomial 
then  the  coefficient  sequence  will  truncate,  and 
the  coefficients  will  be  easy  to  obtain. 

Consider  attempting  to  identify  the  ZNL  g(*) 
from  a  knowledge  of  R^Cx)  and  the  input  autocorre- 


Bandwidth  Properties  of  the  Output 

As  we  noted  earlier,  the  output  Y(t)  will 
possess  a  spectral  representation.  In  this  section 
we  will  consider  how  the  ZNL  affects  the  bandwidth 
properties  of  X(t).  We  will  assume  throughout  the 
sequel  that  the  ZNL  g(*)  is  not  equivalent  to  a 
constant  function;  otherwise,  the  spectral  distri¬ 
bution  function  of  Y(t)  would  simply  be  a  step 
function. 

We  will  begin  by  reviewing  some  results  due  to 
18 

Abramson  .  Assume  that  the  input  random  process 
X(t)  possesses  a  mean  square  derivative,  denoted  by 


J 


E  jx(t)  *(t)} 


19 

X(t).  We  recall  that  X(t)  possesses  a  mean  square 
derivative  if  and  only  if  the  autocorrelation  func¬ 
tion  R(t)  of  X(t)  possesses  a  second  derivative  at 
the  origin.  Let  BW  denote  the  second  moment  band- 
X  2 

width  of  X(t).  That  is,  BW^  is  the  second  moment 

of  the  normalized  spectral  distribution  of  X(t) , 
given  by 

00 

0  f dF(w) 

_ Z 


/  dF(w) 


R"(0) 

R(0) 

where  F(*)  denotes  the  spectral  distribution  func¬ 
tion  of  X(t).  Similarly,  let  BWy  denote  the  second 

moment  bandwidth  of  Y(t),  and  let  Fy( •)  denote  the 
spectral  distribution  function  of  Y(t).  Then 


Since  X(t)  and  X(t)  are  mutually  Gaussian  and  uncor¬ 
related,  they  are  independent.  For  example,  for 

g(x)  -  x3, 

and 

E  {[X(t)]2}«  1  , 

we  have 

BWy  *  /Ts  BWX . 

The  following  result,  due  to  Wise,  Traganitis, 
and  Thomas^,  gives  a  general  relation  between  BW^ 
and  BWy  when  X(t)  is  a  Gaussian  process. 


BW2  -  L*  dFY(<j) 
/  dFy(U) 


20 

We  note  that  BWy  is  finite  if  and  only  if  Ry(i) 

possesses  a  second  derivative  at  the  origin.  If 
BWy  is  finite,  we  have 


BW„ 


R£(0) 

Ry(0y 


We  will  say  that  the  input  X(t)  is  derivative 
independent  if  the  two  random  variables  X(t)  and 
X(t)  are  independent.  (Note  that  we  are  not  as¬ 
suming  that  the  two  random  processes  X(t)  and  X(t) 
are  independent.)  The  following  result  is  due  to 

Abramson^. 

Theorem  2:  If  g  i  #  is  absolutely  continuous,  if 
h(x)=g'(x),  and  if  X(t)  is  a  derivative  independent 
random  process,  then  the  second  moment  bandwidth 
of  the  output  BWy  is  related  to  the  second  moment 

bandwidth  of  the  input  BW^  via 


bw2  .  E  UhtX(t)})2t  •  R(0)  bw2 
Y  E  { (g[X(t) ] )2}  X 


Notice  that  if  X(t)  is  a  mean  square  differ¬ 
entiable  Gaussian  random  process,  then  it  is  deri¬ 
vative  independent.  That  is,  since  R(t)  is  twice 
differentiable  and  is  maximized  at  the  origin,  then 


Theorem  3:  Suppose  that  X(t)  is  a  zero  mean,  sta¬ 
tionary  Gaussian  process  that  has  a  finite  second 
moment  bandwidth  BW^  and  that  possesses  a  spectral 

density  function.  If  g  f  $  is  nonconstant  and  is 
such  that  E  jg[X(t)]J  =  0,  then  the  second  moment 
bandwidth  of  Y(t)  =  g[X(t)]  is  greater  than  or  equal 
to  BW^.  Equality  holds  if  and  only  if  g(*)  is  lin¬ 
ear  . 

As  a  corollary  to  Theorem  3,  it  also  follows 

that 


2  n(bJ 

n-1 _ 

t  Kf 

n»l 


where  b^  is  given  by  (3). 

It  follows  from  Theorem  2  and  Theorem  3  that 
in  these  respective  cases,  the  relation  between  BW^ 


and 


BW  does  not  depend  upon  the  shape  of  the  input 


spectral  distribution.  Instead,  it  depends  only 
upon  the  ZNL  and  the  first  order  distribution  of  the 
input  process.  Some  examples  where  Theorems  2  and 
3  hold  with  non-Gaussian  inputs  are  given  in  the 
respective  papers. 

Now  we  will  consider  the  strict  bandlimitedness 
of  the  output  Y(t).  A  random  process  is  strictly 
bandlimited  if  the  spectral  distribution  has  bounded 


21 

support.  The  following  result,  due  to  the  author  , 
completely  characterizes  the  strict  bandlimitedness 
of  the  output  when  the  input  is  a  Gaussian  process. 


Theorem  A :  Let  X(t)  be  a  stationary,  mean  square 
continuous  Gaussian  random  process  with  a  noncon¬ 
stant  autocorrelation  function,  and  let  g  f  . 

Then  g(X(t)]  is  strictly  bandlimited  if  and  only  if 


R'(0)  -  0 


a)  X(t )  is  strictly  bandlimited,  and 


b)  g(‘)  is  a  polynomial. 


4 


Notice  that  many  common  ZNL's  are  not  poly¬ 
nomials.  In  particular,  it  follows  that  if  X(t), 
given  in  Theorem  4,  is  passed  through  any  type  of 
limiter,  then  the  output  cannot  he  strictly  band- 
1 imi ted . 

21 

The  following  result  establishes  necessary 
conditions  for  the  output  to  he  strictly  band- 
limited  when  the  input  is  a  "contaminated  Gaussian 
process" . 

Theorem  5:  Let  G(t)  and  A(t)  be  mutually  indepen¬ 
dent,  mean  square  continuous,  second  order  station¬ 
ary  random  processes.  Assume  that  G(t)  is  a  zero 
mean  Gaussian  process  with  a  nonconstant  autocor¬ 
relation  function.  Let  X(t)  *  G(t)  +  A(t),  and 
let  g  (  . 


A.  If  g(*)  is  not  a  polynomial,  then  gfX(t)] 
cannot  be  strictly  bandlimited  for  any 
A(t). 

B.  If  G(t)  is  not  strictly  bandlimited,  then 
g[X(t)l  cannot  be  strictly  bandlimited  for 
any  nonconstant  g(*)* 


In  the  sequel  we  will  consider  "randomly  modu¬ 
lated  Gaussian  processes".  To  be  specific,  let  G(t) 
and  A(t)  be  as  given  in  Theorem  5,  and  let  X(t)  = 
A(t)  G(t).  If  C  and  n  are  zero  mean  mutually 
Gaussian  random  variables  with  correlation  coeffi¬ 
cient  a,  and  if  and  are  two  Rorel  measurable 

functions  such  that  g^(0  and  are  both  second 

22 

order,  then  it  follows  that 

E  fgjtO  «2(n)J  =  E«nb  (,)bn(2) 

n=0 


where 

bn(1)  =  E  |gx(0  9n(0| 


and 


bn<2)  ‘  E  ig2(n)  0n(n)l 


and  f)  (■)  is  given  by  (2).  Using  this  result  we 
n 

have  that  the  following  conditional  expectation  is 
almost  surely  given  by 


E  {  g[X(t)]  g[ X { s ) ]  |  A(t),  A(s ) |  - 

Z  [p(t-s)]n  b  [A(t))b  [A(s)J 

_ A  **  " 


relation  function  is  given  by 
E  jg[X(t)|  g[X(s)  )|  “ 


/  * 

E 

(  n=0 


(p(t-s)] 


b  [  A(t ) ]  b  [A(s) ] 
n  n 


) 


Notice  that 


[ p (t-s)]n  b  [ A( t ) ]  b  ( A(s) ]  S 

1  n  n  > 

2  2 
(bn[A(t)))  +  (bn[ A(s) ] ) 

and 

E{S,[(bnlA(t>])2  +  (VA(s)l)2]}' 

2  E^(g[  X(t)] )  }  <  -  . 

Thus  the  Dominated  Convergence  Theorem  justifies 
exchanging  the  expectation  and  the  infinite  summa¬ 
tion.  Therefore,  we  have  that 


E  {g[X(t)l  g[X(s11  j  = 

Z  (P(t-s)]n  E  {b  f  A(  c )]  b  [  A(s)] 

n=0  1  n  n 


Notice  that  b  (•)  can  be  interpreted  as  a  ZNL  and 
n 

thus  [ A ( t )  ]  is  a  second  order  random  process 

that  is  second  order  stationary.  Thus  E  ^b^[A(t)) 


bn[A(s)]} 


is  a  nonnegative  definite  function  of 

(t-s) ,  sav  R  (t-s),  and  it  follows  from  Theorem  1 
n 

that  R  (O  Is  continuous.  Therefore, 


E  jg[X(t))  giX(s)]}  = 


V  I  p  (t-s)]  "  Rn(t-s).  (6) 

n*0 

The  author  has  shown  in  another  paper  that  if 
the  output  autocorrelation  function  has  the  form  of 

(6)  where  o(*)  is  nonronstant  and  R  (•)  is  contin- 

n 

uous  and  nonnegative  definite,  then  the  conclusions 
of  Theorem  5  hold.  Wo  summarize  this  as  the  fol¬ 
lowing. 


where 

bR{y)  *  E  |  g[yG( O  ]  Qn[G(t)]^ 


Theorem  6:  Let  G(t)  and  A(t)  be  as  in  Theorem  5. 
Let  X(t)*A(t)G(t) ,  and  let  g  t  %.  Then  statements 
A  and  B  of  Theorem  5  hold. 


and  where  p  is  the  normalized  autocorrelation  func- 
tion  of  G(t).  Thus  we  see  that  the  output  autocor- 
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Concluding  Remarks 

We  have  presented  some  results  concerning  the 
second  moment  properties  of  the  output  of  a  ZNL 
with  a  random  input.  It  should  be  noted  that  the 
results  we  presented  in  Theorems  3-6  cannot  be  ex¬ 
tended  to  arbitrary  non-Gaussian  random  processes. 
For  instance,  it  is  very  easy  to  exhibit  a  non- 
Gaussian  random  process  which  is  not  strictly  band- 
limited,  but  is  such  that  certain  zero  memory  non¬ 
linear  transformations  upon  it  result  in  a  strictly 
bandlimited  random  process. 
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